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THE LOCUS OF THE RETENTION DIFFERENCES ASSOCIATED WITH DEGREE OF 
HIERARCHICAL CONCEPTUAL STRUCTURE 
Benton J. Underwood, John J. Shaughnessy and Joel Zimmerman 

Abstract: 

Constant-order paired -associate lists were used in which the numbers 
L-24 were stimulvs terms, and 24 nouns were response terms. The order 
of the nouns was varied across five lists to produce a different . number 
of hierarchical conceptual levels in the lists. There V7ere two degrees 
of original learning and three types of retention tests after 24 hr . 
The study-test method was used. Learning rate was related directly to 
the degree of conceptual structure, but retention was uninfluenced by 
structure. A further experiment showed that the direct relation 
between recall and structure found in an earlier study is to be attri- 
buted to the anticipation method in which information at recall is in 
an amount that is directly related to the conceptual structure. 



7\\E LOr:US OF THl^ RETENTION D TKFF.RKNCTvS ASSOCIATED WITH OKGRKE OF 

HlfiRARCHICAL CONCEPTLTAL STRUCTURE^ . 

. . - *■ (• . • ■ 

BontoTu J. UndcrvQod , ^ - John J. Sbaughncissy nnd Joel Zininierin/in 
".j. ' . Northwes'i.ern UnivcrsLty 

In a pre\^loM.s -study' (Undtjrv;ood &. Zimmcrmati, 197 3), [6 v>/brds 
v;erp ordered stiria'llv so Lhjt a Lhreo- Level, conceptual h i erarcli i.c;;i I 
structure resulted. If S., in I enrn iiij; the list, followed tiic rules 
implied by this structure, placeiuent oi' each word in its appropriate 
position within tlic li.sl was po-s.-^tble. Otlier lit^ts were constructed ffroni 
the r;ame words in a way 5iuch as to violate the appropriateness of 
successive conceptual levels. The purpose of this previous study was to 
determine the role of conceptual structure on^the learning and retention 
of the lists. Txvo findings emerged. First, learning rate was related 
directly to degree of conceptual structure up to a point, and second, 
recall after 24 hr . was related di^rjectly to degree of structure. This 
latter finding conformed in general to the notion that associations 
learned in the laboratory whicfi'are compatible with already es'tablished 
associations will show less rapid ff)ri{etti ng than will be the case for 
associations which are in conflict with establ ished Jhabits . In the. 
previous study ^ this latter ca;se was represented at the extreme by the \ 
16 words presented. in random. order . It was presumed that for such, a 
list the long-established conceptual habits would interfere with the 
appropriate, order ing of the words at recall. In factj however, the overt 
error data gave no evidence that the poorer recall of the random list 
than p.f tiie structured list was due to such interference. Thus, the 
reasons for the differences in reca 1 1 remained obscare. 



The intent of the present study was to identify more precisely 
the characteristics of tht> memory for ^structured and unstructured lists. 
By so doing it V7as believed that the charactc*ristic or characteristic's 
responsible for the differences in retention might be isolated. Two 
diifc-rent levels of learning were used as a means of varying the'i degree 
to which the conceptual structure had become a part of the memory for 
the lists. Since the utilisation of a conceptual structure to mediate 
iteiTi placement at the time of retent ion jitay be critically time dependent:, 
three different types of retention tests were used/ namely, "paced and 
unpaced recall, and unpaced associative matching. 

Method 

Lists . Five different lists were constructed, all from the 
following 24 words: robin , owl , bobolink , trout , fiuppy , sturgeon , 
apple ^, lemon , f ig , rose , lilac" , marigold , beer j rum , sherry , milk , sod a , 
cocoa , diamond y opal , sapphire ^ iron , ■ brass , tungsten . These 24 words, 
presented as in the order listed above, formed the most highly structured 
list, to be called List 5. It will be noted that at the -lowest conceptual 
level in List 5 there are three Tnstances of each of eight concepts,, 
birds, fish, fruit, flowers, alcoholic beverages, nonalcoholic beverages, 
precious stones, and metals, • At the' next conceptual level there are- 
' four concepts, animals, plants, beverages, and minerals. At the third 
level, living and nonliving things divide the list in half. 

In List 5 the three ins.tnnces within each concept were ordered 
seriaHy (as" above^ such that 'the first instances had high-frequency in 
the Kat^:lg-^^oatague ('l"^69) noriii.->, the second : med ium frequency, and the 
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11 peaking 5 n:n off \:ho three ins lances v/ithin a concept accord i.i 
fi equ incy • rtile . In the previous study (Underwood & Zimmerman, 
t'hi^: v.'-irir^ble, wi?:h two' xnstancc.vs of Cctcli concept, did not Jtiflucnce 
learning, Hotvever, there were reasons to believe that the earlier ii?:t?. 
were trot cnt i r e ly ' sat is f ac t ory for a test of ': he f r eqvLenc y . r \i 1 e and .s o 
-this variable was included again .in the. present exper.lmeat. 

The nature o\" tlie other four lists may now be described. For 
List 4 the conceptual structure remained the same as in List 5, but the 
order of the throe instances witliin each of the eight concepts wa.s ran- 
domized to neutrali^ce any influence of .a vord- frequency rule. Ii* List 
3 the order of the six animal names was arranged so that the concepts 
birds and fishes were/not appropriate for three successive items, but 
the concept animal was appropriate for a block of six words ( robin , 
trout , sturgeon , owl , guppy ,. bobolink ) . The same was true for. plants,- 
beverages, and minerals. There fore the four intact concepts in List 3 
could TTiediate placement only within a block of six positions. For List 
2 only the living^nbnliving distinction vv-as maintained so that the 
implementation of )this distinction by the would restrict placement to 
halves of the list. Finally, in List 1, the ordering was random so that 
no conceptual mediation of placement of groups of wo.rds was possible. 

The lists were presented as constant-order paired-associate 

lists with the numbers i-2A in order as stimuli and v;i'th the words as 

... ^. ^ 

responff^e terms. In the previous experiment, this procedure gave results 
which were essentially equivalent, to those found when the words were 
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presontud .asJ a true .^oriaL list,- 

CotidltiiQns . One variable, of: coursOj v/as defined by the five 
lists as explained above. A second variable -was the de^rtic of learning 
prior to ihe 24-]?r; retention interval. Half of the S^s le.?crned to a. 
criterion of. 12 correct response5.; on a single trial, half to a criterion, 
of 20 correct respons^os on a rrLnj.^le trial. A third variable wa.s the 
nature of the ret ent ion tost . Half o f 't\\<i Ss were given a paced-reci 1 1 
test, the rate bei:i>^, the same as used during learning. For the'se Ss, 
recall was followed by relcarning to one perfect recitation but with a 
minimum of three relearning trials after the recall trial. Half of the 
Ss were given unpaced xetcntion tests consisting of two steps. Initially/^ 
a sheet was provided the on which the numbers 1 through ?M were listed 
with a blank after each. The S was given uhlin?ited time to write down 
all of the appropriate response terms ho. could, guessing being encouraged . 
Following this step, a list of -the', 24 response words was provided the 
on a second sheet and he was asked to match each word with a number, ^ 

■using each only once. He was required to fill each blank with a word 

•even if it involved guessing. 

The five lists, two degrees of learning, and two types of reten- 
tion tests resulted in 20 different conditions. Four further conditions 

were added to provide controls tor possible di fferential performance ; on 

the posc-cr iter ial trials of learning. The study-test method was used 
during learning, and although t hn use of tliis method is normally expected-, 
to mi:\imi':'e d i f forencoi^ on pdst-cr iter ial trials as a function of rate 

; of learning, it was be]iv;ved neicessary to provide some niiffnual informa- 
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tiou <nbout: the niattor. Consequently, four groups were given immediate 
retention tests after achieving the criterion of 20 correct responses 
on a single trial. Two of tliese groups learned List 1, and two learned 
Li/>t 3. For each list, one group was given paced recall and relorirning, 
one unpaced recall, followed by matching. 

Tht^re were 24 groups of college-student S_s , one corresponding to 
each of the 24 unique conditions, with 18 Ss in each group. Assignment 
to o particular group v/as made from a schedule containing 18 blocks of 
conditions, with each condition occurring once within each block. A 
different random order was used for the conditions V7ithin each block. 

Procedure . All lists were presented for alternate study and test 
trials at a 1.5-sec. rate for both'. When the appropriate criterion was 
achieved, the either was dismissed from the laboratory (to return 24 
hr . later) or was given an immediate retention test. On the immediate 
paced tests the experimenter stopped the memory drum,, told the that he 
would now have another test trial, with further study and test trials to 
follow, and that he should try to get as many correct as possible. For 
the unpaced tests (both immed iate 'and delayed) the recall sheet was 
given the and he was asked to follow the printed instructions on the 
sheet as the experimentet mad these instructions aloud. He was given 
0 second sheet (described earlier) for the matching tost . All S^s having 
24-tir tests were reminded that ihey had learned a list of words the 
previous day and chat a (est of Mieir memories for this list was the 
purpose of the pres(Mit session. - 

Finally, ail S^s having tlic 24-lir retention tests woie ^'Jven an open 
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Glided questionnaire concerning rehearsal activities they might have 
engaged in over the 24 hr. They wore asked to describe any experiences 
they had with the words during the 24-hr period, whether they had rehearsed 
or thotight: about .the words, and so on. Honesty and accuracy were empha- 
sized since (the was told) such replies were valuable in helping to * 
■ uiiderstand the nature of memory. 

Results 

Original learning - For an examination of learning as a functioii of 
list structure, the Ss who would subsequently receive different retention 
tests were combined to provide 36 S^s having had each of the five lists 
at each criterion of learning. The data are plotted in Fig, 1 in terms 
of the mean number of trials required to reach the two. criteria. For 
convenience, the five lists are equally spaced along the baseline, indi- 
cating increasing structure from List ,1 to List 5. It can be seen that 
as list structure increased, trials; to learn decreased. This is true, for 
both criteria, and summed across tlie two the effect is significant 
*' .statistically, F (4 , 350) =8 . 08 , £< . 01 . Although the influence of list 
structure appeared to be somewhat greater for the higher criterion of 
learning than for the lower criterion, the interaction was not reliable*,-'^' 
£■ (4,350)=2,14, £>.05. In the previous study (Underwood & Zimmerman, ' 
1973), learning rate increased from List 1 through List 3 with no further 
increase for Lists 4 and 5. ; t is not known whether this difference is ■ 
due to methods of learning (anticipation versus study-test) or to list 
differences. There Vjas some evidence 5.n the earlier study that some of 
the .instances 'defining the lowest - level concepts were not always under- 
stood by the S_. 

ERIC 
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It Xv^ill be remembered that List 5 differed from List 4 only in terms 
of the ordering .of the three words within each of the eight concepts. 
For List .5 *tho words were ordered from high to low in terms oT the fre- 
quency with which the instances were produced to the concept name in 
the Bnttl.^ and Mont.:i^;ue 0969) normative study. In List 4, clu- three 
words were randomised. As soL'-n in Fig. 1, List 5 was learned more 
rapidly than was lAr^i and thi.s was true for both criteria. An analysis 
of variance with Liscs 4 and .5 as one variable^ and the two criteria as 
the other, showed the diCference between the lists to be reliable, 
F (lj.40)=5.45, .2<-^5. 

fhe effect of word frequency for all lists was also examined. 
Three scores were obtained for each S^, these representing the number of 
times the eight high-frequency instances were given correctly, the number 
of times the eight medicnn- frequency instances were given correctly, and 
the number of times the eight low- frequency instances were given correctly. 
Across all lists combined for the lower criterion of learning the three 
means were 13.99, 11.02 , and 9.84, for the high-, medium-, and low- 
frequency instances, respectively (n^=87.59). These differences essentially 
disappeared at the higher criterion of learning for Lists 4 and 5, but 
were stiill quite evident f:or tVie other three liists. It appears, there- 
fore, that one of the characteristics of initial learning of these lists 
by tlle ^:itlldy-test method was that either because of ease of learning of 
words wltii high f requcTic ies , or because of priority effects, or both, 
the S_ acquired the high- frequency instances initially regardless of the* 



conceptual s-tructure of the list . 

Still another finding could be interpreted as a word-frequency 
effect. Fiome observations of the experimenters suggested that the learn- 
ing of the concepts differed for men, and women. The learning of Lists 
A and 5 were evaluated to see if tfiesc observations had validity. The 
144 Ss (both criteria of learning; consisted of 77 men. and 67 women. 
The number of correct responses within each of tlie eight concepts was 
determined for each group . These are plotted in Fig. 2 for two reasons. 
First, they show the nature of the serial-position curve which obtains 
even for the highly structured lists.' Second, they indicate differential 
learning of certain .concepts by men and women. Overall, the learning of 
tlie two groups did not differ but the interaction between con- 

cepts and sex was reliable, ,.F|(7 J 994)=3 . 13 , £^.01. Three concepts pro- 
duced" substantial differences in learning between men and women, namely, 
flowers , alcoholic beverages , and precious stones . It may be that 
cultural experiences have resulted in women having a greater familiarity 
for words representing flowers and precious stones than is true for men, 
and tliat thj opposite is true for alcoholic beverages . In any event, 
these results are similar to those reported -by Bousfield and Cohen (1956) 
when they used free-recalL learning of groupsof conceptually related. 
v;ords . . 

Figure 2 sug^'.ests that the wards whicli represented the .first 
occurrence of a iKuiliving conce;:)t ^•l Icohol ic beverages) cau.sed a distinct 
break in the pus f t lon-per f ormance curve. However, this is primarily a 
junction ..f the particular words involved.. For Lists 2 and 3, where the 
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I i vinp;-ncnl ivi nj> break also came between positions 12 and 13, there was 
no evidence of discontinuity between the two positions. 

Overt errors . The first overt error analysis to be presented 
dealt., only with the number of errors across lists. The 360 S^s from 
which the acquisition data were derived (as plotted in Fig. 1) were used. 

r " 

TVjc; terror measure v;as the proportion of times an error was produced per 
opportunity (numbei of overt errors/ number of omissions plus overt 
errors). For the 10 [U'ou]?:* th L^: ratio varied between .10 and .19. 
The values were greater statistically for the high-criterion groups than . 
for the low-criterion groups, 1 , 3130) =8 . 33 , £^.01, the means being 
,16 and .12. The errors increased with list structure (.11, .11, .15, 
.15, .16), F(4,350)--4.08,£<.01. The F for the interaction was less than 
one. Undoubtedly, some correct responses resulted from guesses within 
concepts, particularly for the more structured lists, but in view of the 
relatively low proportion of overt errors to cases* of not responding, 
it does not seem likely that mere guessing is heavily involved in the 
correct-response data. 

For Lists 4 and 5, overt errors can be identified as having one of 
four levels of appropriateness in terms of the conceptual structure for 
these lists. These will be described and illustrated. An error may 
occur within the appropriate block of three instances representing the 
same concept. Saying "gappy" to one of the two stimuli to which it was 
an incorrkct response in the block of three fishes was such an error, 
and will be calK-vJ here an error at Level 1, Six words were involved in 
the animal block; if "g^^PPy" was given to one of the three .^:timulus terms 
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approprinte for birds, it was defined as a Lovel-2 error. Twelve words 
were included Ln the living .block; if ^'guppy'^was given to any of che 
six i?tirimli paired with plants, it was called a Level-3 error. Finally, 
if '"i^.uppy" was given as a response to any of the 12 stimuli paired-with 
nGnti"'ing objects, i T v;as called a Level -4 error. All errors were 
clasKiried into ofie of these imitually exclusive categories for Lists A* 
and 5. ConceplMja L Level and po^jition within Listis .A and 5 are perfectly 
con rounded. Position is also tied to stimulus number. Therefore, any 
mcilysis of the appropriateness of overt errors to the 'conceptual struc- 
ture must consider the number of such errors which were produced by 
pojyition per se. To bandit? this problem, the overt errors made in 
learning all five lists were categorized in exactly the same way as was 
done for Lists 4 and 5. For example^ if, for List 1 (no structure-) ^"^a 
misplaced response occurred among the first three pairs, it was classi- 
fied as a Level-i error, just as was done for List 5. Or, if an error 
made- to the st imulus- t(;?rm 9 was an appropriate response for the stimulus- 
term 3, it was classed as a Leyel-3 error. To summarize: for all lists 
the errors were classified as falling within one of eight blocks oiF 
Lhree. positions (Level 1), one of four blocks of six positions (Level 2), 
oJie of two blocks of 12 positions (Level 3), and, all others (Level 4). 

The errors made by each S were allocated to the appropriate level 
and the. percentage of errors in each level was determined. The means of 
these values wore used to construct Fig, 3. The sums of- the percentages 
for a given list do not always equal „J.OO.. since a;few S^s produced no overt 
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errors, and the means shown in Fig. 3 were always based on N=18. It 
'Should be noted that list structure if? along the abscissa, with the 
error levels (1, 2, 3, 4) as the plotting parameter. T^he left panel 
represents the data for the S_s who learned to a criterion of 12 correct;^ 
the right panel for those who learned to a criterion of 20 correct. 
Several features mroy be noted. For Lists 4 and S,. the greatest percen- 
tage of errors by far was that for errors falling into Level 1, Over 
half the errors made by the S^s learning these lists represented errors 
that were appropriate to the harrowest conceptual categories. The Level- 
1 values for List 1, values which should represent in relatively pure 
form the effects of position as such, are at 25% for the lower, criterion, 
40/'o for the higher criterion. In List 3 the narrowest conceptual cate- 
gory consisted of six words. If conceptual structure were used by the 
S in the placement of items in this list, he could—red-u'ceniiR possibili- 
ties to one of six positions.- As ^may be Isee^^n'^inTig . 3, the maximum 
number of Level-2 errors occurred in learning List' 3, these errors 
reflecting placement within a block of six words. For List 1, ■ the random 
list, the maximum frequency of errors for the lower criterion was in 
Level 4, which means giving a response in one half of the list which 
actually belonged iu the other half. There is'only slight evidence that 
the ' living-nonliving distinction influenced the errors, this being 
shown in the fact that fewer errors at Level 4 were made by the Ss 
learning List 2 than by those learning List 1. As would be-expected. 
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. th« major difference ia the errox*s for the two criteria of learning VdS 

that thorp was d.n increase in Level-1 errors from the lower to the higher 

criterion, with the increase being the greatest for the lists with low 

structure. In summary. Fig. 1 showed that learning was related directly 

to the number of appropriate conceptual levels involved in the list; the 

error data of Fig. 3 indicate that these conceptual levels aided learn- 

Lng because they limited the number of possible numerical stimuli or 

positions for ;whli.h a particular word \-7ss appropriate. 

There is the possibility that with ?.ero conceptual structure (List 

1), the presence of conceptually related words actually interfered with 

learning. If such interference was present, it was not manifest in the 
# ..... 

error data. The errors made in learning List 1 were dividied in-to two 
categories, those which were given to a stimulus for which another 
instance of the same concept was appropriate, and those which were not . 
appropriate in the above sense. The concepts used were the eight- with 
the three instances each. To illustrate: saying "guppy^* to the stimulus 
appropriate, for trout would be viewed as evidence for interference; 
giving "guppy'* to the stimulus for milk ^ would not. Errors which would 
constitute evidence for . inter ference constituted 7.6% of the total errors. 
Chance responding would be expected to yield 8,77, of such errors. This 
indicates that Interference resulting from the conceptual relationships 
among the words was minimal in the unstructured list. 

Retention . The retention tiata will be presented first for the S^s. 
who learned to n criterion of 12 correct on a single trial, The results 
for all three re-tention tests are shown in Fig. 4, To replicate tlie 

ERIC 
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earlier study (Underwood 6c ZinnTierman, 1973), performance should have 
increased as list structure increased. It is obvious frotn Fig. 4 that 
lisit structure had little effect on retention. The means for the paced 
24-hr» recall show 'little variance (F<1) . Even for- the unpaced 24-hr. 
test, where List 5 seems high relative to the other, four lists, the is 
only 1.37. The fact that matchin>.^ exceeded unpaced recall indicates 
that the Ss were unable. to recall some response words but could pair 
them appropriately when given the matching test. No immediate test was 
given to Ss learninj^^, to the lower criterion so it is difficult to esti- 
mate, the amount of forgetting which took place over the 24 hr. However, 
the .number correct on the last trial of original learning does give 
some basis for a rough estimate. An immediate test would probably have - 
shown some loss due to the fall normally found after reaching a criterion 
As will be shown later, it would not be unreasonable to expect this loss 
to be at least one to two items. If so, the ainount of forgetting was 
between 3C7o and 40% for the five lists. The critical fact, however, is 
tliat list structure is unrelated to the amount lost over 24 hr. 

. Turning next to the r^t<^.nt ion ■s.cores' for those S^s who learned to a 

i ' ■ 

criterion of 20 correct responses^ the conclusions are much the same as 
for the lower criterion. The essential data are- shown in Fig . 5. For 
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those compnr-' 3ons the immediate retention tests are available for Lists 
1 and 5, but it may be useful to note here that the mean number correct 
on the last test trial of original learning varied between ?1 or 22. 
correct responses. Although there seems to be more variance among the 
means for paced- 24-hr recal 1 than was true at the lower criterion, the 
stf?tistical conclusion is the same, the F for the. paced recall test 
being only 1.74. Even if Lists 1 and 5 are tested for naced recall 
along with the immediate paced recall for those lists, the interaction 
falls short of ncccptable levels of significance, F (1, 68) = 3*34, £ ,05, 
Using the immediate ]viced recall as a base, forgetting under paced 
recall is estimated at 2^1 across the'^lists as a whole. It is obvious 
also that forgetting occurred over 24 hr , for those S^s given the unpaced 
test.. . - 

r The number of misplaced responses at recall was examined for all 
paced-recall groups. These numbers did not differ as a function of the 
-criterion of learning, but for both levels of learning the number of. 
misplaced responses at recall increased as list structure incr'^ased, 
F (4, 170) ~ 5.81, £ .01. This same relat ionship^^was found .during 
learning and so it not a phenomenon peculiar to. recall. . For unpaced 
recall, however, list structure did not influence the number of incorrectly 
paired responses given. 

As noted earlier, during learning of the constant-order paired- 
associate .lis ts , very clear serial-position effects were present. These 
position curves were in evidence for all of the types of retention tests. 
Furthermore, there was a strong relationship between the niimber, of times 
an item was giVen correctly in original learning and the number of times 
given correctly at recall, which is to indicate that the position effects 
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remained essentially constant from learning to recall. For example, for 
the lower criterion, the correlations between number of times correct in 
original learning and number of times correct at recall varied between 
.77. and .91 for the five lists. Degree of original learning was obviously 
a pov/erful determiner of the items which were recalled; 

Relearning . Differences i n relearning' as a function of list 
structure appeared op, the first test Lrlal after recall, and in terms of 
trials to reach a criterion oT one perfect recitation, were reliable;. 
F (4,170)=4.145 £"^.01, with, of course, rate of relearning being directly 

related to structure. Thus, list structure, which did not Influence 

/ 

recall, quickly reinstated during relearning the influence it had had 
during original learning. 

Rehearsal and recall . The S^s were given an open-ended questionnaire 
concerning their rehearsal actlvit ies over the 24 hr . The replies to 
these questionnaires were rated on a 9-point scale for the amount of re- 
hearsal implied in the protocols. These ratings were carried out 
independently by three different people. Interrater reliabilities were 

deterinined for 18 subblocks of 20 S^s each. Of the 54 correlations possi- 

■ '\ 

ble, 11 were between .71 - .80, 29 between .81 -.90, and 14 were .91 or 

! - . ■ ■ . ■ 

-greater. 

There were 20 groups of S^s of 18 -each having 24-hr. recall. All 
correlations between rated rehearsal activity and retention were posi- 
tlve, varying ' betv;eeti .lA and .81. There waS no :relat lon.ship between 
rated rehearsal activity and list structure, and the ma^^nitndo of the 
correlations between rehearsal and retention did not vary systematically 



as a fuact-ion of list structure. 

The positive relationship between reported rehearsal and retention 
allows Sfjveral alternative interpretations, For example, rehearsal may 
liave increased retention^ or, as another interpretation, S^s with good 
retention may have rehearsed. The concern of the present study was 
whether or not reht^arsal differivd as a function of list structure. 
Since It didn*t, it seems unlikely that the failure to find an influence 
of List structure on retention C(7uld be due to differential rehearsal. 
Also. If the present evidence on rehearsal can be generali^ed to the 
earlier study (UiKlerwood &. Zimtnerman, 1973), It seems unlikely that the 
positive relationship between list structure and retention :as reported 
for that study was due to differential rehearsal. 
\' Preliminary Discussion 

In the previous study, paced recall and list structure were directly 
related and the forgetting over 2A hr. for the list with the highest 
structure , was only 5Z'. In the present study , list structure was unrelated 
to either paced or unpaced recall, and the forgetting for the highest 
criterion of learning used was estimated at '257.. The discrepancy be- 
tvjcen these two studies ij the topic of tliis preliminary discussion. 

The contradiction in the retention results for the two studies 
pointed immediacely to a method difference as the likely source for the 
contradiction. In the previous study the anticipation method was used . 
During the recall trial, therefore, the S would be informed of the partic- 
ular concept whose in^stances were appropriate, at the moment for the- 
structured list^s. If, for example, he remembered there were six animal 



names in succession, the appearance of the first instance would inform 
hiin that the next several positions also contained animal names. With 
ti\e. study-test method, the would not be given this information. If 
he did DOf: give the first Instance of a concept at the appropriate point, 
(i:o the correct sLir.'ulns) ^ his following responses would be incorrect 
unlei5S he remember^'d a particular responac cerm associated with a 
stiifiDLu-s r;Grm wi!:]\ii'> vlio ri erie:^ nf concept instances. There v^ere, in 
fact, some cases ir wnlcli did give three to six correct response words 
in the correct order but v;h.ich were scored as wrong because the initial 
response in the series was not paired with the appropriate stimulus. 
This did not occur frequently (and the data show that scoring these as 
correct did not change the -basic conclusion), but the uncertainty felt 
by the may have prevented him from responding overi'.ly. List structure 
clearly influenced learning and relearnirtg/ but some portion of- the 
learning which allowed the S^^ lo align response terms and stimulus terms 
correctly during reaming must have been forgotten over the 24 hr. It 
is* possible that the numerical stimulus terms were not always used as the 
effective stimulus terms and that the lists were treated more as serial 
lists than paired-associate lists, although what this means theoretically 
is not known. It appears that if had learned, for example (for Lists. 
4 and 5), that number 1 was paired with the first bird instance, number 
.4 with the first of three fish instances, and so on, that this part of 
tht:! memory was lost over 24 hr . Otlierwise , there is no reason why pro- 
viding fhis informoCion at recall (as is done in part under tlie antici- 
ptition method) - .should result in berter performance. 
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It seemed necessary to make a test of the notion that the discre- 
pancy in the recall results for tae two experiments was due to a dif- 
ference in methods. In the auxiliary experiment, to be reported now, 
LisLS 1 and 5 were presented For anticipation learning, with recall taken 
after 'm hr . The expectation w:<s that recall of these two lists would 
differ, with List 5 givint^ betCeM: recall than List J. 
Auxl liary Experiment 

Method . Lists I and 5 wercf presented at ■ a 1.5:1.5-sec. rate for 
anticipation learning- " Tlie criterion of original learning was 12 correct 
rei^ponses on a single trial. Paced recall occurred after 24 hr, with 
relearning carried to o.ne perfect trial, but a minimum of three trials 
beyond the recall trial. Each list was. learned by a separate group of 
18 S^s assigned to one of the two lists by a block-randomized schedule. 

Results . In presenting th(. res'alts, comparisons will- be made with, 
the two groups of S^s from the major experiment having the study-test 
method and paced recall, and wlio had learned Lists 1 and 5 to a criterion 
of 12 correct responses befort* the retention interval. There were 18 
S_s*in. each of these two groups. Since the auxiliary experiment was con- 
ducted after the major experiment, it is not known if the groups (study- 
test vs, anticipation) lepresent the same or equivalent populations. 
Therefore, differences in the levels of performance will not be readily 
i.nternretable, althouj^li i utera«. C ions between the methods and lists should 
hi* I iraninjxlul . ' 
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The mean numbers of trials to learn to a criterion of 12 correct, 
and the mean numbers of trials to relearn to one perfect trial j are shown 
for tlid? four groups in Figr^Or" — Por original learning, list structure 
appears to have a ^j^reater influence for anticipation learning than it 
does for the study-test method. List structure is significant (F=25.33'J, 
as is the interaction. F(l ,68)--^4 . 19 , £<.05. The interaction bctv?ecn 
list structure and meth- d does . not occur during relearning, indicating ' 
that the methods iui'luencc on learning is confined to the early stages. 

It will be remembered that for the study-test method the frequency 
of concept instances was directly related to learning. Thiu was quite 
evident at the lower criterion of learning. For List 5^ under the anti- 
cipation method of the auxiliary experiment, the re^srcc: was found. 
More specifically, two findings held across all eight concepts of three 
instances each. First, the initial word. of the three (the high-frequency 
instance) was never given correctly more times than the. second instance 
(the medium-frequency instance). Second, the third word in each of the 
eight concept triads (the low- frequency instance) was always given 
correctly more times than the first instance of the succeeding concept. 
For List 1 under anticipation learning, the effect of word frequency was 
in evidence just as was true for all of the lists learned by the study--- 
test method. The above facts would indicate that item learning under the 
two methods would be more relial>le .for List 1 than for List 5. The 
product-moment correlations for item learning were .83 for List 1, and 
.58 for List 5. The positive relationship for List 5 reflects the 
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coimr.onallty in learning by the two methods produced by serial position 
of the words, differences whirh vcire apparent under both methods. 

Mean overt errors per opportunity were greater in learning under 
rhe anticipation mcilhod (.22) than under the study-test metliod (.13), 
and the difference was reliable, F( i , 68) -9 . 24 , £<[]^. 01. This may represent 
a greater tendency to :;uess under the anticipation method than tinder the 
study-test method.. However, of the overt errors made under the two 
methods, the percentage oi thL-se eirors within the appropriate concept 
position (Level-1 errors as described earlier) was about the same for 
hist 5, being 537, lor anticipation and 547o for the study-test method. 

The mean numbers of correct responses at recall are shown in Fig. 
7, along with the mean number correct on the last learning trial. Under 
the anticipation method, recall was directly related to list structure, 
F(l, 34)=4.97, £<f.05. The interaction between lists and methods for 
rec.all was also rel iable , F(l , 68)=^4.44, £<.05. Recall for Lis-t--5 
under the anticipation method was higher than performance on the last 
learning trial, 24 hr . earlier'. To some extent, these comparisons are 
all in error, a matter which needs discussion. 

Consider first the recall of List 1 under the two methods. A con- 
clusion from an inspection of. .Fig. 7 might be that recall is superior 
following anticipation learning to that following learning by the study- 
test method. However, two factors must be considered. First, the criterion 
fall which may occur under the study-test method, and second, the learning 
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"'.rh occurred on the last trial under the anticipation method. This 
last issue can be hnndled directly. A mult iple-entry probability analysis 
(Underwood, 1964) was carried out to project performance to the hypo- 
thetical next trial under the anticipation method. The mean expected 
value was 14.89. Since recall was 11.67 items^ I'orgetting over 24 hr . 
v;as 3.22 items, or 22%. To incorporate the criterion trail into the 
calculations for List 1 for the study-test method requires a rouj;h 
estimation of values. In the nu) in. experiment , groups were given a recall 
test immediately after reaching a criterion of 20 correct responses. On 
Chis immediate test under paced recall , performance fell from a mean 
correct* L-f -22.00 correct on the last test trial to 18.50 correct on an 
immediately following test trial. This represents a loss of 3.50 items 
which is referred to here as the criterion fall. None of the groups had 
an immediate test following learning to a criterion of 12 correct 
responses. Assume, however, that the group having the study-test method 
and learning to a criterion of 12 correct responses actually forgot 22%, 
the same as forgotten by the gtoup having the anticipation method. This 
would require a criterion fall of 2.75 items. In light of the criterion 
fall' of 3.50 itemis shown by the group learning to 20 correct responses, 
a fall of 2.75 items for those learning to 12 correct would not seem to 
be seriously in error. Given this assumption, the conclusion is that 
for List 1, the amount of forgetting shown under the two methods is 
roughly the same. 

Turning next to List 5, it must first be noted that it was not 



22 



possible to project '*nexL trial'* performance for the S^s learning under 
t!ie anticipation method because several of them learned in one or two 
Iritils. As an estimate, liowever, the percentage projection obtained for 
Lis^: ] was used. This gives a mean expected next-trial value of 17.03 
ilems. Since recall was 15.69 items on the average, the loss over 24 
hr . wu; about 77.., Deriving an expected loss for List 5 following study- 
test learning (usinj^, the value of 2.75 for the criterion fall) ftives a. 
loiis of 3.75 items from l'.^.92j or 297. forgetting. These values must be 
considered approximations, but rhey lead to the conclusion that the loss 
was about the same under the two methods for the unstructured lists," 
but that the anticipation method led to better recall than did the study- 
tfcst method for the highly structured list. Both the estimate of loss 
for List 1 for the anticipatioti method (227.) and the loss for List 5 
under the same method (77,) ..correspond to the findings of the earlier i 
published experiment using this method (Underwood & Zimmerman, 1973). 

The sources of the differences in the retention for List 5 foll^owing 
the learning by the two methods needs more cletailed examination. . The 
data which seem to aid in reaching decisions about the sources of dif- 
ferences are shown in Table 1. The data sheets were examined for the 
'last trial of original learning and for the recall trial. A tabulation 
was n.ade of the number of correct responses which resulted from producing ■ 
all three instances of a concept, the number which resulted from producing 
only two instances of a concept correctly, and the number which resulted 
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from givinj^ only one correct response from among the three possible for 
each concept. When two correct rospons^»s were given, they were broken 
down by position within tlie three possibU> positions (1 «Sc 2, 1^3, 
2 ^ 3). When -i sin^^le correct response was given, the number f.^llint; in 
c-cich of tiie thrv^r' positions was noted. All of tliis information is given 
in Trible 1 for the Utst original Learning trial, and for the recall 
trial, under hotii methods-: For example, on the last learning trial 
uriJer riur ant icip'ii ion nietliod. tliere were 39 cases in which all three 
instances were given correctly, resulting in 117 correct responses, this 
latter- value being shown in Table 1. For this same condition there were 
13 cases in which a single correct response was given for a concept and 
which consisted of the second of the three instances in the series of 
three. 

Several facts are to be noted in Table 1. First, under the antici- 
pation method *there was an actual increase over 24 hours in the number 
of cases in which all three instances were correctly given- (117 to 162). 
In view of the learning wliich may have taken place on the last anticipa- 
tion trial of learning, tliis increase must be viewed cautiously. Never-, 
theles.s, it is in marked contrast to the results found with the study- 
test method, where there was a loss of 108 (210- 102). complete triads. 
The second fact to note i.s the differimce between the two methods in 
both learning and recall when less than three instances were given correctly 
Under the anticipation uicthod, the most probable positions for correct 
responses w}:en cvo were given are positions 2 and 3, and position 3 when 
a single correct response was produced. Comparable relationships do not 
exist for the study-test method, where there was more or less constancy 
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'among the positions. The third fact is that if the number of cases in 
which the first instance (by position) of a concept was given correctly 
was calculated (regardless of the oufcome for the two following instances) 
for recall, the sums were found to be'198 cases for anticipation, and 146 
for sfudy-test . This seems to indicate that, (1) associative learning 
between ..the first instance of the concept and its position or stimulus 
number was greater or better during anticipation learning than during 
study-test learning, or (2), showing the S_ theresponse terms during 
recall allowed him to "deduce" the subsequent occurrence of a first 
instance of a different concept. Both factors may be involved, although 
the latter seems more reasonable. Finally, the data in Table 1 are clear 
in demonstrating that failure of to recall the first instance of a 
concept provides very little penalty under the anticipation procedure, 
since he can proceed to give other instances of the concept for the two 
following positions. 

The evidence seems to point to the fact that learning under the 
study-test method is relatively fragile or weak with regard to positions 
or stimulus numbers which mark the first instance of a new concept. 
The same is probably true for the anticipation learning. However, c5n 
the recall trial the having learned by the study-test method receives • 
no feedback Information and he has Few means to apply corrective proce- 
dures based on any knowledge he had about the conceptual structure. In 
effect, he was reduced to responding on an item by item basis, much as is 
the case for an unstructured li.st.^ On the other hand., the having 
anticipation learning could apply corrective procedures based on his 



knowledge abotit the conceptiuil structure of the list. 

Ceneral D iscussioa 
The higher the conceptual organization of the lists the more rapid 
v;ar; Uvv learning. It is presumed that this relalionship was produced 
because the greater the number of t:he conceptual levels the more precise 
was Lhe placement of an item if the rult^s indicated by the conceptual 
relationships were followed. Nevertheless, this should not be taken to 
mean that the hier -ircli Leal struct.ure In its totality entered into the 
learning of the most completely structured lists. .The could learn 
the sequence of eight concepts of three instances each without reference . 
to the higher-order concepts pre.<-;ent in the list (animals, plants, 
beverages, minerals). . So also, List 3 could be learned by reference 
only to the four successive concepts of six instances each and without 
the living-nonliving distinction per se- entering into the learning. The 
error . data were clear In showing that ac least one level of conceptual 
responding was involved In the learning of Lists 3, 4, and 5, but these 
error data do not speak to the question of whether two or more conceptual 
levels were involved in learning Lists 4 and 5. To determine if two or 
more levels were inv'olved would require the use of list in which the 
blocks of three instances were ordered randomly with respect to the more 
inclusive concepts. A list of this type was not included In the present ^ 
study. 

In the previous study (Underwood & ZiiTimerman, 1973), learning was 
facilitated up through the structure corresponding to List 3 in the 
present study. No further enhancement occurred for Lists 4 and 5. 
This is believed due to the fact th.at the present lists were mado up of 
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n:ore obvious cdnceptf.; and more obvious concept instances than were the 
previous lists Unlike the present findings, frequency of .the concept 
instance with a concept did not influence learning in the previous experi 
tnent .' In view of the findings of the auxiliary experiment <, it seems now 
thot this contradiction is another by-product of the differences in the 
learning by the two methods. 

The majoi: purpoK.e of the present <?tudy was Lo attempt to identify 
the component (s) in memory whf.ch had led to the increase in recnl l over 
2^'^ hr.. as list structure Increased. In an inelegant way, this study v;as 
quite successful in achlevin)^ its purpose. The use of the study-test 
method of learning. was followed by a complete lack pf any differences in 
the recall test s > .whether paced or unpaced . Only relearning, reflecting 
the same relationship as was found in original learning, was related to 
list structure. With the study-test method the original learning was 
apparently based on very weak associations between stimulus number or 
position and words marking the conceptual changes which occurred through- 
out the list. The loss of these associations over 24 hr . essentially ~ 
made the conceptual nature of the lists useless as a recall vehicle. 
The items which were recnll ed were apparently based upon factors specific 
to tliem; 

Cotrsidering mow the broader context of these ■ stud ies , the question 
may be raised about the systematic importance of the earlier study 
{Unden^^qpd & Zimmerman, 1973), :ind the auxiliary experiment of the pre- 
sent, rejiortj In both of which the an t ic ipat ion method was used. Recall 
and list structure were directly related in these studies. However, 
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-the error data from this previous . study gave no support to the idea that 
■forgetting of unstructured lists was produced by interference among the 
conceptual associations among the words. In .the present study there was 
no evidence ■ that conceptual associations played any interfering role in 
learninr;, the unstructured lists. It does not seem now, therefore, that 
tliese types of lists have ariy special or pointed use for the study of 
interference as a source of forj.',et t ing . 

The fact th^iit the structure-recall relationship was found only with 
the anticipation method further reduces the value which one might place 
on the relationship as a basic and important fact of forgetting which 
needs theoret ical. appraisa I . Under the anticipation method, if the S_ 
remembered something about, the nature of the conceptual relationships 
involved (and they were almost inescapable), the information supplied on 
the recall trial by the anticipntion method essentially served as a 
relearning trial. Correspond ini; informat ion vjould not be given in the 
study-test method until flie study trial after the recall trial. If. 
recall following both methods of learning the structured lists was taken •. 
by the unpaced technique as used in the present experiment it is doubtful 
if differences for the two methods would have 9ccurred . Or, if on the 
unpaced test every fourth word (the first instance of each new concept) 
was supplied, reciill would improve markedly and equally following both 
methods of learning, and the improvement would be greater than for 
unstructured lists, These observations, if correct, indicate that the 
systematic problems in the study of forgetting will not be greatly 
illuminated by tlie use of conceptually structured lists designed to 
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restrict potential placement positions in what is essentially serial 
learning. • The more systematic issues appear to lie in studying the 
learning of structured lists, whether of a serial nature, free-recall, 
or some other type of task into which the conceptual structure may be 
i nserted . 
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Table 1 

Comparison of Study-Test and Anticipation Methods with Regard to Concept 
Concept Instance' Lecirnln[.^ and Recall for List 5 
(See text for complete explanation) 

Anticipation Study-Test 
Last OL Recall j Last OL Recall 

Three 117 162 210 102 

Two • • ' 

1 6* 2 22 14 18 .18 
l' 6c 3 , 28 . 20 ' 18 10 

2 &3 62 68 18 8 

One f . - ' . ' - 

.1 6 2- 11 16 — 

2 13 13 2 1 

3 21 12 5 9. 
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LIST STRUCTURE 



Fig. 1. Mean number of trials to reach two different criteria of 
learning (12 correct on a single trial, and 20 correct), 
for lists varying in conceptual structure from low (List 1) 
to iiigh (List 5) . 
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Learning of the highly structured lists as a function of the particular 
concepts (and their positions in the list) by men and women. 
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Fig. 3. Locus of overt errors as a function of list structure and degree 
of learning. The numbers (1, 2, 3, 4) represent an increase in 
the discrepancy between the locus of an error and its correct 
position as defined by the conceptual structure of Lists 4 and 5. 
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Fig. 4. Number of correct responses on the various retention tests 

after 24 hr . following original learning to 12 correct responses. 
Number correct on the last learning trial is also shown. 
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LIST STRUCTURE 

Fig. 5* Number correct on the various 24-hr. retention tests 
following original learning to 20 correct responses. 
Number correct on the immediate tests for Lists 1 and 5 
is also shown. 
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Fig. 6. Learning and relearning scores for Lists 1 and 5 as a 
function of _he study-test (S-T) ^nd anticipation 
(Ant.) methods. 
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LIST STRUCTURE 



Fig. 7. Number correct on the last trial of original learning 
and number recalled after 24 hr . for the study-test 
and anticipation methods. 
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